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Background of the Invention 

Systems interacting with the real world usually take noisy measurements of relevant variables, 
ti7 to estimate the true values of these variables, and make decisions based on the estimates, 
15 as well as available statistical, physical and logical models. A graphical representation of a 
typical system is shown in FIG. 1. As shown in this figure, the estimator 11 combines noisy 
measurements from sensors 10 with the information available from the prior iterations of the 
system's execution and statistical information about the measurement noise in order to come 
up with the estimates of the true values of the measured variables. The decision maker 12 
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uses these estimates and physical models to make decisions. 

We refer to any quantities of interest to the system as state variables. For typical applications 
these variables may be related to the environment, the system, the system's tasks, and any 
5 other cooperating and competing systems. AJl possible values for state variables form the 
state space. The system is able to take measurements of some of the state variables using 
physical and/or virtual sensors. Such measurements are usually corrupted by noise. 
Estimation is the process of selecting optimal values for measured state variables utilizing 
measurements, statistical information about noise, any prior statistical information about state 
10 variables, and any restrictions on possible values of the state variables. Although estimation 
may be a system's sole task, often estimates are utilized in further decision making. A 
system's decisions may affect a subset of state variables. Decisions are made to accomplish 
tasks. Tasks may be specified by constraints on the state space that define target subsets. 

15 Such systems have a wide variety of applications. Two representative examples are 

controllers and prognostic systems. In the first example, a controller may generate control 
policies for an autonomous robotic system. The system uses its sensors to take noisy 
measurements of the environmental and system's state variables. The controller computes the 
control law to be used over the next control loop iteration based on these measurements, 

20 previous state estimates, and models. In the second example, the system rnonitors parts (e.g. 
gears, actuators, pumps, etc.) by taking measurements of their states and reasoning about their 
remaining useful life and any required maintenance actions. 
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Prior Art 

Currently, there are many approaches applied to such problems. They can be roughly divided 
into three groups: unstructured methods that process noisy measurements with no regard for 
models for the problem at hand, methods that fiandamentally combine statistical estimation 
5 with the knowledge of the physical models, and methods that separate the estimating process 
based on statistical models from the reasoning stage based on physical and logical models. 

M ethods belonging to the first group, such as applications of neural networks, use sets of 
input data with known answers to build a representation of the knowledge captured by these 
10 sets of data. The resulting representation serves as the input-output model for the problem 

being solved. Any structured knowledge about the problem, such as physical, statistical and 
logical models is not used. 

Methods belonging to the second group handle estimation and decision making problems in a 
15 combined approach by closely coupling statistical and physical" models. Typical examples of 
such approaches are time series analysis and the Kalman filter. These methods make 
assumptions about dynamics of behavior and statistical distributions, such as linearity and 
normality, to achieve theoretically optimal results. 

20 Methods belonging to the third group separate the problem into two independent 

subproblems, estimation and decision making. The estimation may be performed using a 
variety of statistical approaches. Maximum likelihood estimation and Bayesian analysis are 
two examples of widely used methods. Maximum likelihood estimators examine the 



probability of collected measurements for possible values of measured quantities and choose 
the values of these quantities that maximize such probability as estimates. In Bayesian 
analysis, estimates are computed using noisy measurements, probability distributions of noise 
processes, and prior probability distributions on the quantities being estimated. Once the 
5 estimates are computed, they are used as inputs for the reasoning process. Typically, the 
estimates are handled as if they were true values, although sometimes variances of the 
relevant statistical distributions are taken into account. For instance, the estimated values, and 
in some cases their variances, may be propagated through physical models. 

10 All the methods known in the prior art have shortcomings, which limit their applicability. 
One common limitation of all these methods is their inability to provide guarantees of their 
performance, a property essential to the end user and for the integration of results into further 

decision making analysis. 

15 Methods such as neural networks generally ignore existing expert knowledge about the 

problem at hand. Instead, they rely entirely on being trained using large data sets with known 
answers. For many applications, such data sets are expensive or impossible to obtain. For 
other applications, it is impossible to verify that all possible operational cases, especially low 
probability events, are covered by the training data sets. Additional shortcomings include 

20 inability of the system to adjust to its current task at run-time; having to obtain new training 
data sets and retrain the system with every configuration change; inability to formally reason 
about results at run-time; difficulties in meaningfully fusing results with other information; 
difficulties with integrating existing components into complex systems (e.g. because of 



4 



changes in behavior due to integration); and inability to reason about performance and 
automatically detect failures at run-time. 

Major shortcomings of the methods like time series analysis and the Kalman filter are the 
5 restrictions they place on the statistical and physical models. While they provide theoretically 
optimal solutions, in practice most real systems do not satisfy the required assumptions. 
Improvements, such as the Extended Kalman Filter, address some of these shortcomings, but 
still are not adequate to be applied in general cases when noise distributions are not normal 
and/or dynamics are highly non-linear. Furthermore, these improvements are approximations 
10 of optimal solutions and it is often difficult to evaluate the difference between these 

approximations and the optimum. In addition, all of these methods do not easily incorporate 
restrictions on the values of state variables, such as bounds on their ranges, often the most 
widely available type of information. 

15 Approaches that separate estimation tasks from other processes have the advantage of being 
able to use advanced statistical methods most applicable to the problem at hand. Most widely 
used statistical tools are maximum likelihood estimation and Bayesian analysis. Maximum 
likelihood estimation is often inadequate because it ignores any available prior statistical 
information about the variables being estimated and does not provide a true measure of its 

20 performance (e.g. no probability of correctness associated with the result). Bayesian 

estimation addresses both of these shortcomings, but requires precise knowledge of the prior 
distribution, which is difficult or impossible to obtain. In addition, computation of Bayesian 
results in certain situations may be difficult. If there is only partial prior information 



available, Gamma-minimax estimation may be used. Minimax estimation is applicable when 
no prior information is available. Before now, both of these methods have not been widely 
used due to extreme computational difficulties. W. Nelson, "Minimax Solution of Statistical 
Decision Problems by Iteration", The Annals of Mathematical Statistics, 37:1643-1657, Dec. 

5 1966, presents an iterative process for solving minimax decision problems. However, the 
process is applied to simple finite problems and until this invention, it was not utilized to 
solve continuous minimax problems. A further shortcoming of prior estimation methods is 
their inability to intelligently handle interactions between continuous and discrete phenomena. 
Even the basic task of space quantization is typically done in ad-hoc ways. When formal 

10 approaches are used, spaces are quantized in ways that define discrete problems that are only 
approximations to original continuous problems. In addition, once the estimates are 
computed, they need to be incorporated into the decision making process. Prior approaches 
address this problem in inadequate simplistic ways. One common method simply propagates 
point-valued estimates through physical models. 

15 Brief Summary of the Invention 

We describe methods and systems for estimating quantities corrupted by noise, incorporating 
estimates into decision making processes, and designing systems that perform estimation and 
decision making tasks. 

20 Estimation is performed using a novel method that represents continuous and large discrete 
statistical decision problems by exact compact finite representations that fully capture the 
stmcture of the original problem. They compute exact solutions and not approximations. 
These estimators support incorporation of restrictions on ranges of state variables being 



estimated. They also support use of the zero-one loss function, as well as Bayes, Gamma- 
minimax and minimax optimality criteria. They enable output in the confidence set format 
and guaranteed performance. Furthermore, they can be rigorously incorporated into hybrid 
systems, which are systems that involve interactions between discrete and continuous 
5 phenomena. These estimators are task-driven, in the sense that they can accept task 

requirements as inputs. They are ideal for supporting information fusion and for integration 
into decision making processes. 

Decision making processes are performed using a novel method that computes decisions 
10 based on information about state variables represented as confidence sets. Such information 
may be obtamed from the estimators described in this invention. In addition to incorporating 
information in the form of confidence sets, this rhethod is capable of flising information from 
various sources, as well as integrating information about effects of possible decisions on state 
variables, for example, in the form of physical, logical and statistical models. Funhermore, it 
15 is capable of integrating non-statistical restriction information about state variables, model 
parameters, and errors in decision implementations. It supports incorporation of costs of 
resources, performance specifications and task specifications, and enables guaranteed 
performance. This method can be utilized to build a novel iterative system for decision 
making under uncertainty in situations where decisions at previous iterations affect 
20 measurements at future iterations. 

This invention enables definition of a framework for formal design and implementation of 
decision making systems and methods. Since state estimation and decision making systems 
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based on this invention can guarantee their performance and are task-driven, a system can be 
built to calculate trade-offs between various design decisions, evaluate design choices, and 
automate the design processes. 

Brief Description of the Drawings 

5 FIG. I shows a block diagram of an estimation and decision making system of the 

prior art. 

FIG. 2 shows a flowchart summarizing one estimation embodiment of this invention. 
FIG. 3 shows a minimax decision rule for a finite representation problem for an 
estimation embodiment of this invention. 
10 FIG. 4 shows an extended minimax decision rule for an estimation embodiment of 

this invention. 

FIG. 5 shows a block diagram of an example of an improved estimation and decision 
making system of the current invention. 

Detailed Description of the Invention 

1 5 Estimation 

Many computer applications involve data items corrupted by noise. Sources of such noisy 
measurements include physical and virtual sensors. Physical sensors include devices whose 
purpose is to output one or more measurements based on properties associated with monitored 
objects. Virtual sensors include devices and software modules that produce one or more 
20 measurements based on computations or data processing. For example, measurements can be 
computed based on outputs of physical sensors or generated through simulations. A software 
module may be a set of instructions executed by a computer or an analog or digital signal 
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representing computer code. A computer may be, but is not limited to, an embedded 
microprocessor, a general-purpose computer, any other device capable of performing analog, 
digital or quantum computation, or a plurality of computers networked together. 

5 We sometimes refer to original uncorrupted data items as state variables. There may be 
additional state variables that are not measured, but are of interest for a particular problem. 
The set of all values that a state variable can assume is called the state space of the variable. 
The Cartesian product of state spaces for all state variables is called the state space. 
Estimation takes measurements as inputs and utilizes other available information to estimate 

10 optimal values for state variables. Thus, estimation may be viewed as a fijnction that depends 
on an optimality criterion and available information, takes measurements as inputs, and 
produces estimates as outputs. Such functions are often called decision rules. Depending on 
the number of and relationships between state variables and measurements, as well as 
optimality criteria being used, estimation may be a very difficult task to accomplish. 

15 

This invention achieves significant advantages over methods known in the prior art by 
representing estimation problems with complex state spaces (continuous or large discrete 
spaces) by equivalent estimation problems with the state space for at least one state variable 
replaced by a finite state space. These finite representations are not approximations. They are 
20 exact representations capturing the fijndamental structure of the original problem. Decision 
ixiles for the original problem can be computed by computing decision rules for the 
representation and extending results. In one embodiment of this invention, the 
representations are compact (containing relatively few points) and minimal (no point in the 



state space of the representation can be removed without affecting exactness). 

Finite state spaces simplify computation of decision rules. This invention enables solutions to 
decision problems that methods known in the prior art have not been able to solve. 

5 Compactness of representations enables efficient computation of decision rules making this 
invention applicable to situations where there are constraints on computational resources or 
time available for computation, for example embedded real-time applications. Furthermore, 
decision rules for problems with finite state spaces are typically piecewise constant functions, 
which can be efficiently stored and applied. For some applications, the rules can be pre- 

10 computed and stored for run-time use with minimal utilization of data storage resources. 

There is a variety of methods known in the prior art that utilize Bayes decision rules for 
estimation. This invention enables the use of decision rules, which are based on other 
optimality criteria. Bayes rules can be applied when prior probability distributions for state 

15 spaces of state variables are available. Often this information is difficult or impossible to 
obtain. For problems with finite state spaces Gamma-minimax and minimax decision rules 
may be computed. In one embodiment of this invention, minimax decision rules are 
calculated by applying the method described in W. Nelson, "Minimax Solution of Statistical • 
Decision Problems by Iteration", The Annals of Mathematical Statistics, 37:1643-1657, Dec. 

20 1 966. In particular, solutions are found for previously unsolved minimax decision problems 
with continuous state spaces by computing decision rules for their finite representation 
problems and extending the resulting rules. In another embodiment of this invention, 
Nelson's method is extended to Gamma-minimax decision problems. Minimax estimation 
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can be applied when there is no prior statistical information available about state variables. 
Gamma-minimax estimation can be applied when partial prior statistical information about 
state variables is available. For example, such information may be in the form of an envelope 
of probability distributions. When such information can be represented by bounds on 
5 probabilities for the points in a finite representation problem, an extension of Nelson's 

method can be applied to compute Gamma-minimax decision rules because the set of possible 
priors forms a convex subset of the set of all priors. Thus, optimization can be performed 
following the same method, but restricting its range to prior probability distributions 
constrained by known information. 

10 

Through its use of finite representations, this invention enables the incorporation of a variety 
of different loss functions into the estimation process. For example, one embodiment of this 
invention uses the squared-error loss, which is a common loss function used in estimation 
applications throughout the prior art. Another embodiment of this invention uses the zero-one 

15 loss function (a function whose value is 0 if the estimate is within a certain distance from the 
true value and 1 otherwise). Ability to use this loss fianction is of great benefit for many 
applications because the risk of the corresponding decision rules is equivalent to the 
probability of failure, leading to estimates in the confidence set format. Unfortunately, it is 
greatly underused due to decision rule computation difficulties encountered by the methods 

20 known in the prior art. Since estimates are usually computed in order to be used in decision 
making processes, it is beneficial to have their output in a format that supports such use. 

This invention enables computation of decision rules for applications with a variety of noise 
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distributions. One embodiment of this invention computes decision ailes when the noise 
distribution possesses the Maximum Likelihood property (this includes Gaussian noise). 
Another embodiment of this invention computes decision rules when the noise distribution is 
Cauchy. In general, finite representation problems can be solved for an extremely wide range 
5 of noise distributions and in many cases for situations when noise distributions are not 
precisely known, such as when noise distributions are only known to belong to a class or 
envelope of distributions. 

A further advantage of this invention is its ability to incorporate restrictions on the values of 
10 state variables. In fact, bounds on these values are required to compute finite representations 
and obvious bounds are easily obtained from application contexts (e.g. obvious bounds on 
distance and velocity). When meaningful restrictions are available from coarse sensors, 
computation, geometry, logical rules, state space constraints, previous iterations of decision 
making systems (when decisions affect state variables) and other sources, their incorporation 
1 5 can significantly improve estimates. In many applications, this is the most widely available 
type of information. 

A fijrther advantage of this invention is the ability of its estimators to guarantee their 
performance. Although optimal in theory, the methods known in the prior art do not provide 
20 performance guarantees. This is due to the fact that they do not formally handle deviations 
from assumptions. For example, most of the prior art estimators use Bayesian optimality 
criterion and squared-error loss. When prior probability distributions required for Bayesian 
methods are not fi^illy known (which is the case for most problems of interest) estimators are 
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not optimal. Estimators described herein provide performance guarantees by utilizing 
Bayesian estimation when prior probability distributions are fully known, Gamma-minimax 
estimation when partial prior information is available, and minimax estimation when no prior 
information is available. Furthermore, decision rules that are theoretically optimal for 
5 continuous problems remain optimal when implemented in embodiments of this invention 
because finite problems solved computationally within these embodiments are exact 
representations and not approximations. 

In one embodiment of this invention, decision rules are based on the zero-one loss fijnction 
leading to estimates in the form of confidence sets. An advantage of this invention over 
methods known in the prior art is that such estimators can be task-driven. If the estimation is 
performed to accomplish a certain task, either the required minimal level of confidence, 
maximal size of the confidence set or both can be determined from the task specification. If a 
decision rule that satisfies these requirements cannot be computed, it can be determined 
automatically that the task cannot be accomplished. In addition, the reason for the failure and 
the steps required to rectify it can be determined. 

A further advantage of this invention is that it enables rigorous handling of interactions 
between discrete and continuous phenomena. Systems involving such interactions are called 
20 hybrid systems. Applications of such systems can greatly benefit from formal analysis 
supported by this invention through the use of finite exact representations capturing 
fundamental properties of continuous problems. For example, one embodiment of this 
invention supports computation of optimal quantizations of continuous spaces. 
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In one embodiment of this invention, there is a plurality of measurements. There may be 
multiple measurements of the same state variable or multiple measurements of multiple state 
variables. If measurements are independent, estimation can be performed for each measured 
state variable separately. However, if there are dependent measurements, multidimensional 
decision rules have to be computed. This invention simplifies computation of such rules by 
using a cross product of finite spaces as the state space for a finite representation problem. 

Set-valued Minimax Estimation Embodiment Using the 0-1 Loss Function 

Estimation may be performed using the steps summarized in the flowchart in FIG. 2. These 

steps are as follows: 

Determine a restriction, 5, on the state variable being estimated (Step 20). 

For example, the state variable may represent the distance between two objects 
and this distance may be known to lie in the interval [-d,d\ due to geometric 
constraints. 

Determine the required size of the estimate, s, and the required level of performance, p 
(Step 21) 

For example, both may be determined from the current task specification. 
Since there is a tradeoff between these two quantities, it is possible that the 
requirement cannot be satisfied. 
Determine the finite representation (Step 22). 

For example, if the measurement is corrupted by the additive Cauchy noise, a 
finite representation containing n^'^ldls] points may be computed. One 



possible representation is a decision problem with the state space of {-cT, {d- 
(m-l)s)\ {-d-^s)\ {cl-{m-2)s)\ {-d+2s)\ (-rf+(/7?- 1 >y , d) where w = /?/2 (for 
77=6, this becomes {-^, id-2s)\ ('drhs)\ (d-s)\ ('d^2s)\ d}), the set of 
possible estimates {-dr^e, 'd+2e^ ...0, d'2e, d-e) where e^sl2 (for w=6, this 
becomes {-dr^e^ -i/+2e, 0, d-2e^ d-e}), and a slightly modified zero-one loss 
function defined for a possible estimate a by L{a/)=0 if (s/2<a<t-\-s/2, L(a/ 
)=0 \f t-s/2<a<t-^s/2 and L(a/)= L{a/)=l otherwise. In this notation, the 
points /" and t are treated differently from the point /g9? only when the loss 
function L is applied, and are otherwise treated as / in all computations. 

Compute a minimax decision rule for the representation problem (Step 23). 

The rule may be computed using Nelson's algorithm. Alternatively, a pre- 
computed rule may be used. 

Extend the decision mle to the original problem (Step 24). 

Apply the extended rule to the measurement to compute an estimate E (Step 25). 

FIG. 3 depicts the minimax decision rule for the representation problem when S=['d,d\, d is 
approximately 28.53 and \S\/s=2, and the noise is additive and has the standard Cauchy 
probability distribution. FIG. 4 depicts the extension of this rule to the original continuous 
problem. Note that the rule for the finite problem exactly captures the shape of the rule for 
the continuous problem with the switching points between classes of estimates being the 
same. 
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Decision Making 

We describe a framework for decision making under uncertainty. Applications of this 
framework are enabled by a novel method for incorporating information represented in the 

5 form of confidence sets into decision making processes. This invention achieves significant 
advantages over methods known in the prior art by its novel use of confidence sets to 
encapsulate uncertain information. In one embodiment of this invention at least some of the 
confidence sets are obtained by using a state estimation system described herein. The 
estimators of this invention are ideal for integration into decision making because they can 

10 incorporate restrictions in the form of bounds on the values of state variables and can be 
adapted to the current task specification (decision rules can be computed based on the 
required size of resulting estimates and probabilities of success). Integration is further 
simplified due to the fact that confidence sets with complex shapes may be enlarged to sets 
with more manageable shapes. The action of enlargement does not reduce the level of 

15 confidence, so if all the values in the resulting set satisfy performance requirements, so would 
the original set. 

Confidence sets guarantee that the values of state variables belong to them. This guarantee 
enables formal computation of decisions. One embodiment of this invention preserves this 
20 performance guarantee throughout the decision making process. This can be accomplished by 
representing all uncertain information in the form of confidence sets and all certain 
information in the form of sets. The estimates in the confidence set format may be propagated 
through physical and logical models for different possible decisions. Since models are 
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typically not known exactly, model parameters can be represented by bounded sets. Since 
effects of some decisions may be in the form of real-world physical actions and such actions 
are imperfect (for example, due to wear-and-tear or imperfect manufacturing of actuators), 
effects of decisions may be represented by bounded sets as well. Since this method starts with 
5 guaranteed estimates and uses sets of values that are known to contain the true value of non- 
measured items at each step (or a confidence set), it ends up with a guaranteed result. If a set 
of decisions satisfies task requirements (which may include the required probability of 
success) as computed, it is guaranteed to satisfy task requirements as implemented. At run- 
time, situations may arise when task requirements cannot be satisfied. The system can 
10 automatically detect these situations and compute corrective actions. If unforeseen situations 
arise, where the system is able to compute decisions satisfying task requirements, but task 
requii'ements are not satisfied when these decisions are implemented, this invention supports 
discovery of the discrepancy and intelligent recovery. 

15 A further advantage of this invention is its ability to flexibly incorporate task requirements 
into the decision making process. In one embodiment of this invention, tasks are determined 
by a task planning module. Complex tasks may be broken up into sequences of basic tasks. 
From task specification, the system can compute task requirements and if every module, 
including estimators, guarantees its performance, the system can compute an optimal plan for 

20 the use of its modules and resources. If the cost of resources is specified or can be computed, 
such cost can be incorporated into computations. If the cost of actions is specified or can be 
computed, such cost can be incorporated into computations. 



A further advantage of this invention over the methods known in the prior art is its ability to 
represent all available information in the common format of bounded sets. For stochastic 
quantities, such as estimates or some values of state variables affected by decisions, these sets 
are confidence sets with attached confidence probabilities. For non-stochastic quantities, such 

5 as information about unmeasured state variables (which may or may not be affected by 

decisions) these sets are known bounds on their values. Even imperfect knowledge of noise 
distributions can be handled by using envelopes of distributions. Available information may 
commonly include estimates based on measurements from sensors, known bounds on 
measured quantities, known bounds on unmeasured quantities, bounds on parameters in 

10 dynamic models (if physical models are used in the decision process), bounds on task 

specifications (tasks can be specified as target subsets of variables affected by decisions), and 
bounds on effects of decisions. 

Information fusion is arguably one of the hardest tasks for decision making systems. This 
15 invention provides the framework that facilitates combining various types of information due 
to the simple, yet rigorous, representation of information. The common format, combined 
with formal estimators grounded in statistical decision theory, enables fusion of information 
from various system components and different systems. This property makes this unified 
framework ideal for assembling complex systems from heterogeneous components and for 
20 implementing cooperative systems. At the same time, its ability to support minimax decision 
mles makes it ideal for implementing systems competing against adversaries. 



18 



Example of an Iterative Decision Making Embodiment 

This invention defines a framework for making decisions under uncertainty. While this 
framework can be used to make single iteration decisions, its advantages over methods known 
in the prior art are fully brought to light when applied to iterative decision making processes. 
5 Such an embodiment is shown in FIG. 5, which is a block diagram of an iterative decision 
making system. In this embodiment, a set of sensors (physical or logical) 50 may take a set of 
noisy measurements, which are processed by the estimating module 51. The estimator 51 
may use information about constraints on the ranges of measured quantities and any prior 
statistical information about their distributions, if available, to compute confidence set-valued 

10 estimates. The task planning module 52 may determine the performance for the current 
iteration required to accomplish the task and decide which sensors should be used based on 
the performance they support and the cost of using them (time, resources, operational 
constraints, etc.), as well as the required frequency of iterations. If the required performance 
cannot be achieved, the system is able to automatically detect the failure and react to it. 

1 5 Computed estimates, together with any knowledge of the bounds on the ranges of non- 
measured quantities involved in the decision making process, may be utilized by the action 
generation component 56 of the decision maker 53 to select a set of actions that keep 
quantities affected by system's decisions within bounds specified by the task planner 52. This 
may be accomplished by the action propagation component 54 of the decision maker 53. This 

20 component may use dynamic and/or logical models combined with known bounds on the 
ranges of model parameters and known bounds on the ranges of effects of actions. If no 
action satisfying task requirements can be found, the system will detect the failure and react to 
it. From the computed task-conforming set of actions, the action selection component 55 may 



select an action based on its cost and other optimality criteria (e.g. passenger comfort in an 
aircraft, wear-and-tear minimization, etc.). The action propagation component 54 may 
compute the set of possible values at the time of the next iteration for quantities affected by 
the decision. This set, together with similar sets from other iterations, may be used to 
5 determine if the iteration frequency has to be adjusted and as an optional input to the 

estimating module 51 to further constraint ranges of measured quantities at the next iteration. 

Use of the Invention 

Some examples of application areas impacted by this invention are as follov^s: 

10 

Control Law Generation. This invention supports control law generation for a variety of 
systems including autonomous robotic systems and embedded controllers. 

Condition Based Maintenance. This invention supports monitoring of mechanical 
15 components, health assessment, prognostic reasoning and maintenance planning. 

Financial Planning. This invention supports decision making based on imperfect knowledge 
of financial data and future events affecting values of investments. 

20 System Integration. This invention provides a common framework for integrating 
heterogeneous components. 

System Cooperation. This invention provides a common framework for information 
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exchange and task performance by cooperative systems. 

Competitive Systems. This invention is founded in the statistical decision theory and supports 
minimax decision making. It is ideal for applications that involve competing and adversarial 
5 systems. 

Hybrid Systems. This invention provides a framev^ork for rigorous design and 
implementation of systems involving interactions between continuous and discrete 
phenomena. 

10 

System Design. This invention supports a rigorous system design process. Given a set of 
task specifications (including performance requirements), this invention supports reasoning 
about required resources and components, such as sensors, actuators and algorithms. It 
clearly exposes inherent tradeoffs between design costs (including length of design process 
15 and model building efforts), implementation costs, performance, sensor accuracy, actuator 
accuracy, and computational requirements. 

While this invention has been particularly shown and described, all examples, applications 
20 and referenced embodiments are for explanation and illustration purposes only. It will be 
understood by those skilled in the art that various changes in form and details may be made 
therein without departing from the scope of the invention encompassed by the appended 
claims. 
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